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FOREWORD 


The  Organizations  and  Systems  Research  Laboratory  of  the  U.S.  Army  Research 
Institute  for  the  Behavioral  and  Social  Sciences  ( ARI)  assists  the  Army  as  it 
seeks  optimal  utilization  of  its  combat  systems.  ARI  provides  its  assistance 
via  two  general  avenues:  by  developing  methods  for  training  or  selecting  sol¬ 
diers  to  interact  wi  1  and  operate  existing  systems,  and  by  participating  in 
the  development  of  new  systems  to  assure  that  they  are  designed  with  the  human 
operator  in  mind. 

The  work  reported  here  involves  a  facet  of  development  aimed  at  fielding  a 
new  training  system  for  the  AH-1  Cobra  helicopter.  As  a  part  of  Army  Project 
2Q263743A772,  Aircrew  Performance  Enhancement  in  the  Tactical  Environment,  ARI 
was  an  active  participant  in  Operational  Test  II  (OT  II)  of  the  AH-1  flight 
simulator.  For  OT  II,  ARI  developed  and  implemented  a  transfer  of  training 
methodology  designed  to  determine  optimal  trade-offs  between  differing  amounts 
of  relatively  inexpensive  simulator  training  and  resultant  relatively  expensive 
training  required  in  the  AH-1  aircraft. 

This  paper  presents  the  trade-off  functions  derived  and  a  detailed  descrip¬ 
tion  of  the  methodology  employed.  The  methodology  is  suitable  for  evaluation 
of  other  simulators  to  be  used  in  initial  skill  training. 
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TRAINING  DEVICE  EFFECTIVENESS: 

FORMULATION  AND  EVALUATION  OF  A  METHODOLOGY 


BRIEF 


Requirement : 

In  December  1978  the  U.S.  Army  acquired  a  prototype  AH-1  Cobra  helicopter 
flight  simulator  (AH1FS) .  The  effectiveness  of  this  machine  as  a  training  de¬ 
vice  and  as  an  economy  measure  was  not  known  at  that  time .  A  method  was  re¬ 
quired  that  could  yield  quantified  cost  and  training  effectiveness  indices. 


Procedure : 

Students  receiving  training  on  the  AH-1  aircraft  at  the  U.S.  Army  Aviation 
Center  (USAAVNC) ,  Fort  Rucker,  Ala.,  spent  varying  amounts  of  time  in  the  AHlFS 
before  advancing  to  training  in  the  aircraft.  The  amount  of  required  subsequent 
training  in  the  aircraft  was  recorded  as  a  function  of  amount  of  AHlFS  training 
received.  For  each  maneuver  in  the  program  of  instruction  (POI) ,  trade-off 
functions  of  AHlFS  training  versus  subsequent  required  aircraft  training  were 
derived . 


Findings: 

The  AHlFS  was  found  to  be  an  effective  training  device  in  the  sense  that 
subsequent  to  AHlFS  training,  less  training  was  required  in  the  aircraft.  The 
trade-off  function  parameters  were  quantified,  and  a  method  for  maximizing  the 
cost  and  training  effectiveness  of  the  simulator  was  developed. 


Utilization  of  Findings: 

Training  effectiveness  results  were  used  in  USAAVNC 's  integration  of  the 
AHlFS  into  the  AH-1  POI.  The  cost-effectiveness  and  methodology  and  results 
served  as  the  primary  input  for  the  cost  and  training  effectiveness  analysis  of 
the  AHlFS  conducted  by  the  U.S.  Army  Training  and  Doctrine  Command. 
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TRAINING  DEVICE  EFFECTIVENESS: 
FORMULATION  AND  EVALUATION  OF  A  METHODOLOGY 


INTRODUCTION 

Implicit  in  the  acquisition  of  any  simulation  training  system  is  the  as¬ 
sumption  that  training  objectives  are  more  economically  attained  through  a  mix 
of  simulation  and  hands-on  training  than  through  hands-on  training  alone.  This 
was  the  concept  guiding  the  U.S.  Army  in  1967  when  the  basic  requirements  and 
projects  for  a  Synthetic  Flight  Training  System  (SFTS)  were  first  elaborated. 
Faced  on  the  one  hand  by  rapidly  increasing  training  and  operating  costs  and 
encouraged  on  the  other  by  advances  being  made  in  training  simulator  technology, 
the  Army  embarked  on  a  long-range  SFTS  development  program,  developing  first  the 
UH-1  Iroquois  (Huey)  instrument  flight  simulator  and  then  the  CH-47  Chinook 
visual  flight  simulator.  The  latest  addition  to  the  SFTS  program  is  the  AH-1 
Cobra  visual  flight  and  weapons  system  simulator  ( AH1FS) .  The  first  prototype 
AH1FS  was  accepted  for  Army  operational  and  developmental  testing  in  December 
1978. 


Overall  summary  reports  of  operational  test  results  (Bridgers,  Bickley,  & 
Maxwell,  1980)  and  developmental  test  results  (Millard,  Casto,  &  Blackwell, 

1979)  appear  elsewhere.  This  paper  reports  in  detail  the  operational  evaluation 
of  the  AH1FS  as  a  training  medium  for  transitioning  rated  rotary  wing  aviators 
to  the  AH-1  aircraft.  The  report  has  three  general  sections.  The  first  de¬ 
scribes  the  derivation  of  a  novel  methodology  for  evaluating  simulators  used  in 
initial  or  transition  training;  the  second  presents  the  results  of  applying  this 
methodology  in  testing  the  AH1FS ;  and  the  third  describes  how  the  data  obtained 
can  be  used  i"  the  cost  and  training  effectiveness  analysis  of  a  simulator. 


METHODOLOGY 


Training  Effectiveness 

As  indicated  above,  the  motive  behind  training  simulator  development  is 
economy  in  training.  The  economy  achieved  is,  of  course,  determined  by  the  cost 
and  the  effectiveness  of  a  unit  of  simulator  training  relative  to  the  cost  and 
effectiveness  of  a  unit  (in  the  present  case)  of  aircraft  training.  With  past 
simulators,  the  cost  differential  between  simulator  and  aircraft  training  has 
been  so  great  that  a  marginally  effective  simulator  might  be  used  to  realize 
overall  training  savings.  However,  as  simulators  have  grown  more  complex  and 
expensive  to  operate,  the  differential  has  shrunk  to  the  point  that  precise 
quantitative  determination  of  training  effectiveness  is  becoming  a  major  step 
in  U.S.  Army  simulator  testing  and  acceptance  procedures. 

Training  effectiveness  can  be  viewed  and  defined  in  many  ways  (see  Murdock, 
1957),  but  as  Roscoe  (1971)  points  out,  traditional  measures  of  effectiveness 
fail  to  consider  costs  associated  with  pretraining  or  simulator  training.  Ros¬ 
coe  has  proposed  the  cumulative  transfer  effectiveness  ratio  (CTER)  as  a  more 
useful  alternative  for  the  training  psychologist.  The  CTER  is  defined  as 

CTER  =  (^  -  /  x^,  (1) 


1 


where  x^  is  training  received  in  a  simulator, 


is  training  required  in  the 


aircraft  after  x^  simulator  training,  and  ^  i,  training  that  would  be  required 

in  the  aircraft  were  no  simulator  available.  The  ratio  compares  training  sav¬ 
ings  in  the  aircraft  as  a  function  of  amount  of  simulator  training:  a  CTER  of 
.75  would  indicate  that  for  some  x  units  of  simulator  training,  each  unit  is 

equivalent  to  .75  unit  of  aircraft  training.  The  CTER  is  of  great  use  to  the 
training  psychologist  as  a  measure  of  training  effectiveness  and  was  success¬ 
fully  employed  in  Holman's  (1978)  evaluation  of  the  CH-47  flight  simulator. 

But,  as  Roscoe  points  out,  the  CTER  is  not  a  constant  but  is  very  much  a 
decreasing  function  of  the  value  of  x.  .  In  fact,  it  can  be  seen  that 


lim 


x 

— i 


V 

*-o 


X  . 
—1 


(2) 


Thus,  each  empirically  established  CTER  will  be  valid  only  for  some  arbitrarily 

small  neighborhood  around  its  particular  x  . 

— i 

From  the  training  psychologist's  point  of  view,  an  ideal  measure  of  train¬ 
ing  effectiveness  should  convey  the  same  information  as  does  the  CTER,  but  it 
should  also  allow  computation  of  training  effectiveness  of  all  x. .  This  could 

be  accomplished  by  regressing  CTER  on  various  experimental  values  of  x,  but  a 
simpler  and  more  direct  approach  is  to  regress  jr  on  x;  that  is,  find  a  suitable 
prediction  rule  or  function  that  can  be  used  to  relate  the  independent  variable 
of  x  relatively  inexpensive  units  of  flight  simulator  training  with  the  depen¬ 
dent  variable  of  relatively  expensive  units  of  aircraft  training  required  to 
attain  the  training  objective.  Once  this  training  effectiveness  function  re¬ 
lating  units  of  simulator  training  with  units  of  subsequently  required  aircraft 
training  is  determined,  the  training  psychologist  can  apply  the  respective  cost 
factors  associated  with  the  two  training  media  to  the  function  and  minimize  the 
resulting  total  cost  function. 


Derivation  of  Model 

Now  that  the  potential  utility  of  such  a  concept  of  training  effectiveness 
has  been  illustrated,  how  can  the  function  relating  x  and  be  characterized? 

In  this  section,  a  model  relating  simulator  and  aircraft  training  will  be  de¬ 
veloped,  both  intuitively  and  theoretically,  and  evaluated  against  extant  em¬ 
pirical  data. 

At  the  intuitive  level,  one  would  expect  that  the  function  being  sought 
would  exhibit  several  characteristics.  At  x  =  zero  (no  simulator  training),  ^ 
is  equal  to  the  CTER's  the  amount  of  aircraft  training  required  when  a  sim¬ 

ulator  is  not  used.  As  x  increases,  should  decrease;  that  is,  as  the  amount 
of  simulator  training  increases,  the  amount  of  subsequent  required  aircraft 
training  should  decrease.  However,  the  rate  of  decrease  should  not  be  constant; 
f> om  the  nature  of  the  CTER,  it  is  known  that  the  pay-back  from  investing  more 
jnits  '■‘f  training  in  the  simulator  becomes  less  and  less.  That  is,  although 


the  rate  of  change  of  y  with  increasing  x  is  negative,  it  approaches  zero,  re¬ 
sulting  in  some  asymptotic  minimum  nonnegative  value  of  y  that  will  be  denoted 
by  £.  The  value  of  £  represents  the  amount  of  aircraft  training  that  must  be 
done  to  attain  the  training  objective  regardless  of  the  amount  of  simulator 
training  administered.  For  the  training  effectiveness  model,  £  is  conceptually 
representative  of  task  elements  that  cannot  be  trained  by  simulation  but  must 
be  learned  in  the  aircraft.  For  those  cases  in  which  all  task  elements  can  be 
trained  in  the  simulator,  £  would  be  equal  to  zero.  An  intuitive  graph  of  the 
function  is  shown  in  Figure  1. 


Figure  1.  Hypothetical  function  relating  amount  of  simulator 
training  received  with  amount  of  subsequent  re¬ 
quired  aircraft  training. 

Consider  y  as  it  ranges  between  a  maximum  at  y^  and  a  minimum  of  )/  =  £. 

Just  as  £  can  be  conceptualized  as  representative  of  the  elements  that  must  be 
learned  in  the  aircraft,  the  quantity  y^  -  £  can  be  considered  as  representative 

of  the  potential  aircraft  savings  that  can  be  realized  by  using  the  simulator. 
Assume  that,  as  x  increases,  the  rate  at  which  y  decreases  (and  savings  accrue) 
is  a  constant  proportion  of  y  -  £.  This  assufll^tion  can  be  represented  mathe¬ 
matically  as  the  linear  differential  equation 

d(y  -  £) 

- -  =  -b  (y  -  £)  ,  (3) 
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where  b  is  the  proportional  constant.  Substituting  £  for  £  -  £,  equation  (2) 
becomes 


d(£) 

sr -  ' 


which  has  general  solution 


where  a  is  an  arbitrary  constant.  Replacing  £  by  £  -  £  in  (4)  yields 


-bx 

£  =  ae  —  +  £. 


(4) 


(5) 


Equation  5  is  then  a  good  theoretical  candidate  for  the  function  the  training 
psychologist  seeks  in  relating  simulator  training  with  aircraft  training. 


Other  than  the  study  reported  here,  little  quantitative  data  for  evaluation 
of  the  model  are  to  be  found  in  the  literature;  most  training  effectiveness 
studies  are  oriented  toward  transfer  of  training  proportions  or  toward  CTERS 
and  have  not  systematically  varied  x,  the  amount  of  simulator  training  given, 

A  notable  exception  occurs  in  a  study  by  Povenmire  and  Roscoe  (1973) .  In  eval¬ 
uating  a  generic  aircraft  simulator,  Povenmire  and  Roscoe  gave  general  aviation 
students  up  to  11  hours  of  instruction  in  the  simulator  followed  by  training  to 
criterion  in  the  aircraft.  These  data  are  plotted  in  Figure  2.  The  curve  in 
Figure  2  is  a  rough  fit  of  equation  5  to  their  data.  For  this  fit,  the  propor¬ 
tional  constant  b  has  an  approximate  magnitude  of  .397,  which  is  well  within 
its  theoretically  expected  range. 


Level  of  Analysis 

To  this  point,  no  mention  has  been  made  of  the  specific  level  at  which  the 
proposed  analysis  is  to  be  made.  In  the  case  of  the  Povenmire  and  Roscoe  (1973) 
data,  the  analysis  was  made  at  the  level  of  the  entire  curriculum:  data  were 
collected  in  terms  of  the  total  time  students  were  trained  in  the  simulator  or 
in  the  aircraft.  Thus,  any  measure  of  effectiveness  derived  is  a  measure  of 
the  training  device  as  a  whole.  However,  it  may  be  that  the  device  is  more  ef¬ 
fective  in  one  area  of  training  than  in  another.  The  training  analyst  requires 
information  as  to  the  device's  areas  of  greatest  effectiveness  so  that  training 
curricula  may  be  developed  that  capitalize  on  the  simulator's  training 
strengths.  One  way  this  information  can  be  obtained  is  by  evaluating  the  simu¬ 
lator  at  the  level  of  individual  training  maneuvers .  In  using  this  level  of 
approach  in  the  evaluation  of  the  Army's  CH-47  helicopter  flight  simulator 
(CH47FS) ,  Holman  (1978)  found  that  although  the  CH47FS  is  effective  overall 
(.82  average  CTER) ,  CTERs  for  individual  maneuvers  ranged  from  zero  to  2.80. 

In  view  of  this  finding,  and  since  the  AH1FS  has  incorporated  most  of  the 
CH47FS's  technical  design  features,  it  was  decided  to  evaluate  the  AH1FS  at  the 
level  of  individual  maneuvers.  The  general  approach  taken  was  to  administer  to 
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Total  simulator  training  hours 


regular  flight  students  varying  amounts  of  AH1FS  training  in  each  maneuver  and 
then  to  observe  the  additional  amounts  of  aircraft  training  required  for  them 
to  attain  proficiency. 


PROCEDURE 


Participants 

Instructors .  Instructor  pilots  (IPs)  then  assigned  to  the  Attack/Aeroscout 
Branch  of  Hanchey  Division  of  the  Department  of  Flight  Training  of  the  Direc¬ 
torate  of  Training  of  the  U.S.  Army  Aviation  Center  (USAAVNC)  served  as  flight 
instructors.  The  IPs  were  all  experienced  aviators,  qualified  in  the  AH-1  air¬ 
craft,  and  graduates  of  the  Attack/Aeroscout  Branch's  Methods  of  Instruction 
course. 

Students.  Participants  were  rated  Army  rotary  wing  aviators  selected  from 
regular  USAAVNC  AH-1  transition  classes  in  residence  from  April  to  August  1979. 
Some  participants  received  all  their  training  in  the  AH-1  aircraft;  others  re¬ 
ceived  AH1FS  training  followed  by  training  in  the  ai-craft. 

Administrative  constraints  and  scheduled  daily  AH1FS  availability  re¬ 
stricted  the  experimental  sample  size  per  class  to  eight  for  aircraft  training 
only  and  to  six  for  simulator  plus  aircraft  training.  Only  commissioned  officer 
students  in  the  grade  of  captain  or  below  and  warrant  officer  students  in  the 
grade  CW3  or  below  were  considered.  The  remaining  selection  criterion  was  num¬ 
ber  of  total  flight  hours:  participants  with  the  lowest  number  of  total  flight 
hours  \  selected. 


Apparatus 

The  AH1FS  is  a  high-technology  training  device  that  simulates  the  AH-1 
aircraft  cockpit  and  instrumentation,  aircraft  motion  and  vibration,  aircraft 
power  plant  and  weapons  noise,  and  out-the-window  view.  It  is  designed  to  af¬ 
ford  training  in  visual  contact  flight,  instrument  flight,  and  weapons  delivery 
techniques.  A  detailed  description  of  the  device  is  found  in  Millard  et  al. 
(1979);  a  more  general  description  for  the  purposes  of  this  report  appears 
below. 

As  shown  in  Figure  3,  the  AH1FS  has  three  general  subsystems:  the  train¬ 
ing  platforms,  the  computer  interface,  and  the  camera  model  boards.  The  two 
training  platforms  correspond  to  the  pilot's  and  the  copilot/gunner's  two  cock¬ 
pits  in  the  AH-1  aircraft.  Within  a  platform,  the  trainee's  station  is  within 
the  simulated  cockpit,  and  the  instructor's  station  is  to  the  trainee's  right 
rear.  All  aircraft  controls  and  instruments  are  simulated  for  the  trainee.  At 
the  instructor’s  station  are  the  means  for  complete  control  of  the  training  en¬ 
vironment.  The  instructor  has  available  three  major  training  features:  pre¬ 
recorded  maneuver  demonstrations,  problem  "freeze,"  and  training  "play-back." 
The  IP  cannot  easily  manipulate  the  simulated  cockpit  controls  but  can  invoke 
from  the  computer  any  of  a  number  of  recorded  maneuvers  to  be  demonstrated  to 
the  trainee.  Also,  at  any  point  the  instructor  may  freeze  all  training  parame¬ 
ters  in  time  and  space,  point  out  or  discuss  some  matter  of  interest  to  the 
student,  and  then  continue  simulator  training  in  real  time.  The  play-back 
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Figure  3.  General  schematic  of  AH1FS. 


feature  allows  the  instructor  to  let  a  student  review  1  to  5  minutes  of  the  im¬ 
mediately  preceding  performance  as  recorded  by  the  computer.  Under  normal 
training  conditions,  there  is  no  need  for  instructors  to  interact  with  any  per¬ 
sonnel  outside  the  training  platforms. 

The  computer  interface  serves  to  translate  the  trainee's  and  the  instruc¬ 
tor's  inputs  into  changes  in  the  training  environment.  Trainee  control  inputs 
are  translated  into  corresponding  instrument  and  audio  feedback,  simulation 
motion  of  the  training  platform,  and  changes  in  the  simulation  visual  scene. 
Instructor  inputs  are  translated  into  training  situation  initial  setups,  replays 
of  previous  training,  changes  in  simulation  environmental  variables,  initiation 
of  simulated  aircraft  malfunctions,  and  so  forth. 

The  camera  model  boards  are  1500:1  scale  models  of  generic  countryside, 
including  gunnery  ranges  and  a  helicopter  stagefield.  Control  inputs  from  the 
trainee  platforms  are  translated  by  the  computer  interface  into  movement  com¬ 
mands  to  a  periscope  positioned  over  the  model  board.  The  dynamic  periscopic 
view  is  transmitted  via  a  closed-circuit  color  television  system  to  viewing 
screens  at  the  simulated  cockpit  windows.  The  pilot's  cockpit  field  of  view 
(FOV)  extends  18°  above  and  below  the  horizontal  and  from  24°  to  the  right  of 
center  to  77°  to  the  left  of  center,  for  an  effective  36°  by  101°  FOV.  The 
gunner's  cockpit  FOV  is  36°  vertical  by  48°  horizontal  centered  straight  ahead. 
The  trainees  are  presented  a  virtual  color  image  with  a  static  visual  resolution 
of  approximately  10  arc  minutes. 


Preliminary  Activities 

Instructor  Training.  Before  the  study  began,  three  experienced  IPs,  se¬ 
lected  by  the  Scout/Attack  Branch,  received  a  5-day  instructor -operator  course 
conducted  by  the  simulator  manufacturer.  Primary  topics  were  simulator  operat¬ 
ing  procedures  and  simulator-specific  instructional  strategies.  At  the  end  of 
training,  all  three  were  judged  as  qualified  AH1FS  instructor-operators  by  both 
the  manufacturer  and  the  Army  simulator  test-acceptance  pilot  assigned  to  the 
pro j  act. 

Data  Specifications.  As  indicated  above,  it  was  decided  the  level  of  anal¬ 
ysis  for  the  study  would  be  that  of  the  individual  maneuver.  Prior  to  the 
study's  start,  the  suite  of  maneuvers  then  taught  by  the  Scout/Attack  Branch 
was  identified.  Following  the  general  format  developed  by  Holman  (1978) ,  a 
booklet  allowing  for  collecting  data  on  up  to  four  daily  repetitions  of  each 
maneuver  was  developed.  (Table  3  lists  the  maneuvers  evaluated.)  Data  col¬ 
lected  on  any  one  maneuver  repetition  included  the  number  of  training  minutes 
spent  in  performing  the  repetition  and  a  rating  of  the  trainee's  overall  per¬ 
formance  on  the  repetition.  The  scale  used  for  the  overall  rating  is  shown  in 
Table  1.  A  rating  of  7  on  this  scale  corresponds  to  a  satisfactory  performance 
level. 

All  Scout/Attack  Branch  AH-1  IPs  were  instructed  in  the  use  of  the  data 
collection  booklet  and  rating  scale.  Before  starting  the  test,  each  IP  had 
satisfactorily  demonstrated  use  of  the  booklet  by  recording  data  from  one  of 
his  regular  transition  course  students. 
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Table  1 


Maneuver  Rating  Scale 


Rating 


Description 


0  Demonstration  by  IP;  no  evaluation. 

1  IP  immediately  had  to  take  back  control  of  aircraft. 

2  Performance  deteriorated  until  IP  was  finally  obliged  to  take  back 
control  of  aircraft. 

3  Student  required  considerable  verbal  assistance. 

4  Some  parameters  within  course  limits;  verbal  correction  from  IP 
required. 

5  Some  verbal  assistance  required;  less  than  one-half  of  parameters 
within  course  limits. 

6  Minimal  verbal  assistance;  more  than  one-half  parameters  within 
course  limits. 

7  Few  parameters  outside  course  limits;  student  corrected  performance 
without  coaching;  still  lacks  good  contrc1  touch. 

8  All  parameters  within  course  limits;  work  needed  on  control  touch. 

9  Outstanding;  no  perceptible  deviations  from  standards;  SIP-level 
performance. 


AHlFS  Training  Amount  Determination.  As  indicated  previously,  the  overall 
test  methodology  was  to  involve  observing  the  amount  of  aircraft  training  re¬ 
quired  after  various  amounts  of  AHlFS  training.  Subsequent  regression  analysis 
of  these  data  would  require  that  the  amounts  of  AHlFS  training  selected  be  in¬ 
dependent  of  the  trainees.  Specifically,  in  such  a  regression  analysis,  par¬ 
ticipants  cannot  have  been  trained  to  some  level  of  proficiency;  having  done 
so,  in  effect,  would  have  allowed  trainees  to  determine  their  own  amounts  of 
AHlFS  training  and  thereby  have  violated  the  underlying  assumption  of  indepen¬ 
dent  assignment  of  training  amounts.  Thus  it  was  determined  that  for  each  ma¬ 
neuver,  each  participant  would  receive  one  of  three  prespecified  numbers  of 
training  repetitions  in  the  AHlFS. 

Figure  1  indicates  that  the  magnitudes  of  the  three  values  chosen  can  be 
critical  to  the  analysis.  If  all  three  independent  variable  values  chosen  are 
too  large,  then  the  resulting  dependent  variable  values  will  all  lie  in  the 
asymptotic  portion  of  the  curve,  and  inferences  about  the  descending  portion  of 
the  curve  may  lack  precision.  On  the  other  hand,  if  all  three  values  chosen 
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are  too  small,  then  the  dependent  variable  values  will  all  lie  in  the  descend¬ 
ing  portion  of  the  curve,  and  inferences  about  the  magnitude  of  the  asymptote 
may  lack  precision.  It  can  be  seen  that,  ideally,  independent  variable  values 
for  each  maneuver  should  be  chosen  so  that  resultant  dependent  variable  values 
fall  both  in  the  descending  and  in  the  asymptotic  portions  of  the  curve. 

Since  the  AH1FS  was  a  new  piece  of  equipment  with  no  quantitative  training 
effectiveness  history,  estimation  of  each  maneuver's  ideal  amounts  of  training 
had  to  be  based  on  several  outside  considerations.  First,  Scout/Attack  Branch 
IPs  were  asked  to  estimate  the  average  number  of  AH-1  aircraft  repetitions  the 
average  AH-1  transition  course  student  requires  to  reach  institutional  profi¬ 
ciency  in  the  aircraft.  Also,  for  maneuvers  common  to  both  the  AH-1  and  CH-47, 
data  collected  in  the  CH-47  flight  simulator  evaluation  (Holman.  1978)  were  ex¬ 
amined.  Then,  based  on  these  data,  on  their  sizable  experience  as  IPs,  and  on 
their  perceived  effectiveness  of  the  AH1FS  as  a  training  device,  the  AH1FS  IPs 
and  the  simulator  project  test  pilot  individually  and  then  collectively  esti¬ 
mated  for  each  maneuver  three  amounts  of  AH1FS  training  that  should  capture  both 
the  descending  and  the  asymptotic  portions  of  the  generic  curve  shown  in  Fig¬ 
ure  1.  The  values  decided  upon  are  indicated  along  the  abscissae  of  the  indi¬ 
vidual  maneuver  plots  presented  in  the  results  section  below. 


Method 


Because  of  various  operational  considerations,  it  was  decided  that  partic¬ 
ipants  trained  in  the  AHlFS  would  each  receive  training  on  every  maneuver  in 
the  simulator;  data  for  each  maneuver  for  the  condition  "no  AHlFS  training"  were 
to  be  collected  from  participants  receiving  all  their  training  in  the  AH-1  air¬ 
craft.  The  normal  AH-1  transition  course  as  taught  at  USAAVNC  had  a  maximum  of 
12  students  and  lasted  4  weeks,  with  a  new  class  starting  every  2  weeks.  Par¬ 
ticipants  to  receive  AHlFS  training  were  selected  from  every  other  class;  par¬ 
ticipants  to  receive  aircraft  training  only  were  selected  from  each  class  as 
feasible . 

AHlFS  Training.  Participants  to  receive  simulator  training  were  instructed 
to  consider  the  device  as  a  "pretrainer"  to  facilitate  their  subsequent  train¬ 
ing  in  the  aircraft;  they  were  told  not  to  expect  the  device  to  train  them  to 
proficiency.  They  followed  the  same  general  daily  training  routine  as  their 
aircraft-trained  counterparts.  The  standard  daily  routine  allowed  for  two  in¬ 
structors  each  to  train  three  students  for  1*5  hours  each.  Except  for  the  use 
of  simulator-specific  features  such  as  free,  play-back,  and  demonstration  tapes, 
the  AHlFS  instructor  pilots  followed  the  same  standard  curriculum  and  sequence 
of  training  that  was  being  used  in  the  aircraft.  The  only  major  departure  from 
the  standard  was  in  progression  through  the  curriculum:  whereas  individual 
training  progression  was  based  on  proficiency  in  the  aircraft,  in  the  AHlFS 
progression  was  based  on  completion  of  the  prespecified  numbers  of  training  it¬ 
erations  of  each  maneuver.  For  each  participant  for  each  maneuver,  the  pre¬ 
specified  level  of  training  to  be  received  was  assigned  randomly  under  the  con¬ 
straint  that  overall  equal  numbers  of  participants  received  each  of  the  three 
levels.  After  completion  of  AHlFS  training,  participants  began  training  in  the 
aircraft. 


10 


Aircraft  Training.  The  AHIFS-trained  participants'  first  exposure  to  the 
AH-1  aircraft  was  a  diagnostic  checkride  administered  by  a  Standardization  In¬ 
structor  Pilot  (SIP)  from  the  USAAVNC  Directorate  of  Evaluation/Standardization. 
Based  on  the  results  of  this  checkride,  the  participant's  AH1FS  instructor  con¬ 
tinued  training  him  to  proficiency  in  the  AH-1  aircraft.  When  the  instructor 
considered  the  student  proficient  in  the  aircraft,  the  student  was  given  an 
end-of-course  aircraft  checkride  by  another  IP  and  released  from  training. 

Those  participants  not  receiving  training  in  the  AH1FS  received  normal  instruc¬ 
tion  and  training  in  the  aircraft. 


RESULTS 


Subjects 

Instructor  Pilots.  Of  the  three  instructors  originally  trained  to  operate 
the  AH1FS,  one  participated  in  the  entire  study,  one  was  never  assigned  to  the 
study,  and  the  third  was  released  approximately  halfway  through  the  study  be¬ 
cause  of  an  unavoidable  reassignment  within  the  Scout/Attack  Branch.  Before 
the  third  instructor's  departure,  he  trained  a  successor  who,  prior  to  instruct¬ 
ing  in  the  simulator,  was  certified  as  qualified  by  the  project  test-acceptance 
pilot . 

During  the  study,  the  Scout/Attack  Branch  experienced  unforeseen  shortages 
of  both  personnel  and  aircraft.  The  effects  upon  the  study  were  twofold:  new 
IPs  with  no  experience  with  the  data  collection  booklet  entered  the  training 
system,  and  many  times  students  trained  in  the  aircraft  received  aircraft  in¬ 
struction  from  more  than  one  IP.  As  new  IPs  began  carrying  students,  they  were 
instructed  in  the  use  of  the  data  collection  booklet  and  began  collecting  data 
on  their  students.  A  new  IP's  first  students'  da'.a  were  discarded.  Also,  any 
data  on  students  receiving  instruction  from  more  than  two  IPs  (not  counting  the 
checkride  IPs)  during  the  4-week  transition  course  were  discarded  from  the 
analysis . 

Students.  A  total  of  21  students  began  training  in  the  AH1FS.  With  the 
exception  of  one  who  was  grounded  for  medical  reasons  unrelated  to  the  test, 
all  successfully  completed  AH-1  flight  training.  A  total  of  25  students  entered 
the  study  to  receive  aircraft  training  only.  Due  to  the  above-mentioned  prob¬ 
lems  with  instructor  availability,  data  from  all  but  ]4  of  these  students  were 
discarded.  Descriptive  data  of  all  35  students  is  shown  in  Table  2. 


Maneuvers 


Missing  Data.  If  in  simulator  training  Tl  participant  received  as  many  as 
two  fewer  or  as  many  as  two  more  training  repetitions  for  a  maneuver  than  had 
been  assigned,  the  data  for  that  maneuver  were  discarded.  This  condition  gen¬ 
erally  arose  because  of  abnormally  low  simulator  availability  or  through  over¬ 
sight  on  the  part  of  the  simulator  IPs.  Also,  for  some  maneuvers,  some  students 
trained  in  the  aircraft  alone  were  neither  trained  to  criterion  (as  defined 
below)  nor  tested  on  that  maneuver  on  the  end-of-course  checkride.  Data  in 
these  cases  were  also  discarded.  Thus,  in  most  of  the  results  given  below,  data 
for  a  maneuver  are  bused  on  a  sample  of  fewer  than  35. 
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Table  2 


Student  General  Characteristics 


Characteristic 

Low 

Average 

High 

1. 

Age 

2] 

27 

32 

2. 

Total  rotary  wing  (RW) 
flight  hours 

160 

594 

2,500 

3. 

Total  RW  flight  hours 
in  last  6  months 

0 

95 

190 

4. 

Years  since  graduation 
from  RW  flight  school 

0 

2.3 

9 

Overtraining.  It  was  discovered  early  in  the  study  that  although  the  AH-1 
transition  course  was  (within  the  limits  of  its  4-week  duration)  self-paced  and 
proficiency-based,  overtraining  unavoidably  occurred  on  some  maneuvers.  For 
example,  since  most  training  involving  takeoffs  and  landings  or  autorotations 
involved  flying  a  traffic  pattern  around  the  training  stagefield,  students  in 
the  aircraft  routinely  received  considerable  overtraining  in  flying  traffic 
patterns.  Thus,  after  consulting  with  all  the  instructors  involved,  it  was  de¬ 
cided  that  a  student  would,  for  purposes  of  the  study,  be  considered  to  have 
attained  proficiency  on  a  maneuver  in  the  aircraft  after  earning  a  rating  of  7 
for  three  consecutive  training  repetitions  and,  of  course,  after  earning  at 
least  a  7  on  the  maneuver  on  the  end-of-course  checkride.  All  aircraft  train¬ 
ing  subsequent  to  the  three  7s  criterion  was  considered  overtraining  and  not 
included  in  the  analysis  below. 

Presence  of  Trend.  As  a  general  indicant  of  degree  of  overall  relationship 
between  amount  of  AH1FS  training  and  subsequent  required  AH-1  aircraft  training, 
eta-squared  was  computed  for  the  data  for  each  maneuver.  The  values  found, 
which  for  this  sample  of  participants  may  be  interpreted  as  the  proportion 
of  variance  accounted  for  by  knowledge  of  amount  of  AH1FS  training,  are  en¬ 
tered  in  Table  3. 

Regression  Analysis.  For  each  maneuver,  the  data  described  above  were  fit 

-bx 

to  the  function  f_(x)  =  a£  —  +  £  using  the  SPSS  subprogram  NONLINEAR  (Robinson, 
1977),  Marquardt's  method  was  used  to  obtain  parameter  estimates;  iteration 
ceased  when  the  largest  relative  change  among  the  three  parameters  became  less 
-8 

than  1.5  x  10 

Figures  4  through  34  show  the  results  for  31  maneuvers.  Each  figure  shows 
the  observed  mean  amount  of  aircraft  training  required  after  various  amounts  of 
AHlFS  training  and  the  standard  error  of  the  mean.  For  each  maneuver,  the  curve 
generated  by  its  best-fit  parameters  is  plotted  through  the  data  points,  and  an 
F-ratio  of  goodness -of -fit  (Lewis,  1960)  is  given. 
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Table  3 


Degree  of 

Association  Between  AH1FS  and  AH-1  Training 

Maneuver 

N 

a2 

1. 

Cockpit  procedures 

34 

.82 

2. 

Takeoff  to  a  hover 

32 

.56 

3. 

Hover  flight 

33 

.59 

4. 

Landing  from  a  hover 

35 

.71 

5. 

High-speed  flight 

33 

.60 

6. 

Normal  takeoff 

33 

.  35 

7. 

Normal  approach 

33 

.79 

8. 

Maximum  power  takeoff 

29 

.63 

9. 

Steep  approach 

30 

.44 

10. 

Running  landing 

23 

.64 

11. 

Traffic  pattern 

33 

.64 

12. 

Hydraulics  failure 

27 

.72 

13. 

Forced  landing,  power  recovery 

27 

.53 

14. 

Autorotation  to  touch-down 

31 

.53 

15. 

Autorotation  with  turn 

33 

.29 

16. 

Autorotation,  termination  with  power 

19 

.05 

17. 

Hovering  autorotation 

32 

.49 

18. 

Left  anti-torque  failure 

28 

.61 

19. 

Right  anti-torque  failure 

27 

.53 

20. 

Low-level  autorotation 

28 

.43 

21. 

Low-level,  high-speed  autorotation 

26 

.24 

22. 

Hover  out  of  ground  effect 

25 

.56 

23. 

Terrain  flight  takeoff 

23 

.48 

24. 

Terrain  flight 

26 

.44 

25. 

Terrain  flight  approach 

22 

.36 

26. 

SCAS  off  operations 

22 

.09 

27. 

Weapons  cockpit  procedures 

25 

.49 

28. 

FFAR  ballistic  correction 

27 

.46 

29. 

FFAR  firing 

28 

.49 

30. 

20mm  ballistic  correction 

27 

.74 

31. 

20mm  firing 

24 

.65 
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Figure  4.  Cockpit  procedures. 
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AH1FS  repetitions 
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Figure  7.  Landing  from  a  hover. 
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Figure  8.  High-speed  flight. 
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'igure  9.  Normal  takeoff. 
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Figure  11.  Maximum  power  takeoff. 
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Figure  12.  Steep  approach. 
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Figure  13.  Running  landing. 
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Figure  14.  Traffic  pattern. 
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Figure  17.  Autorotation  to  touch-down 
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Autorotation,  termination  with  power.  (Axes  offset  to  aid  legibility. 


Figure  20.  Hovering  autorotation.  (Axes  offset  to  aid  legibility. 
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Figure  21.  Left  anti-torque  failure. 
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Figure  24.  Low-level,  high-speed  autorotation. 


25.  Hover  out  of  ground  effect.  (Axes  offset  to  aid  legibility. 


Figure  32.  FFAR  firing.  (Axes  offset  to  aid  legibility. 


DISCUSSION 


As  indicated  at  the  outset,  a  major  objective  of  the  test  of  the  AHlFS  was 
to  evaluate  a  methodology  for  quantifying  training  and  cost  effectiveness  of 
simulators.  In  this  section,  the  success  of  the  methodology  in  capturing  the 
simulator's  effectiveness  will  be  scrutinized,  and  a  straightforward  application 
of  the  results  to  curriculum  development  will  be  outlined. 


Training  Effectiveness 

The  overall  data  indicate  that  the  AHlFS  is  an  effective  device  in  train¬ 
ing  nearly  all  maneuvers  investigated.  This  conclusion  is  evidenced  by  the 
general  reduction  in  required  aircraft  training  for  each  maneuver  following 
simulator  training.  But  results  of  particular  interest  are  those  pertaining  to 
the  accuracy  of  the  transfer  model  and  the  success  of  the  methodology  in  obtain¬ 
ing  usable  input  for  efficient  cuniculum  design. 

Presence  of  Trends.  The  initial  data  analysis  indicates  that  in  most 
cases  there  is  a  functional  relationship  between  the  amount  of  simulator  train¬ 
ing  and  the  amount  of  subsequent  aircraft  training.  Table  3  shows  that  for  this 
sample,  except  for  "autorotation,  termination  with  power"  and  "SCAS  off  opera¬ 
tions,"  between  25%  and  80%  of  the  variance  in  aircraft  training  amounts  can  be 
accounted  for  by  the  amount  of  simulator  training,  depending  on  the  maneuver. 
Hence,  there  is  some  motivation  for  attempting  to  fit  a  model  to  the  data. 

Goodness-of-fit.  In  all  cases,  the  model  fits  the  data  for  each  maneuver 
with  values  for  a  and  c  within  their  theoretically  expected  ranges.  (Problems 
with  values  for  b  will  be  discussed  below.)  However,  it  is  difficult  to  judge 
the  absolute  goodness-of-f it  of  any  model.  For  the  curve-fitting  routine  used 
with  most,  parameter  values  are  selected  that  maximize  the  precision  with  which 
the  dependent  variable  can  be  predicted  from  the  independent  variable.  Of 
course,  the  predicted  values  and  their  corresponding  observed  dependent  vari¬ 
able  values  will  differ;  the  magnitude  of  the  variance  of  this  difference  is  a 
general  indicant  of  goodness-of-fit:  small  variance  results  from  a  good  fit. 
However,  for  a  given  level  of  the  independent  variable,  there  will  be  variance 
in  the  resultant  levels  of  dependent  variable  observed.  If  this  variance  is 
conceptualized  as  the  "noise"  inherent  in  the  data,  then  at  least  that  much 
noise  is  also  to  be  expected  in  the  precision  of  prediction  using  the  best-fit 
parameters.  To  the  extent  the  variance  of  the  fit's  precision  exceeds  that  of 
the  dependent  variable  observed  values,  the  fit  can  be  regarded  as  bad.  Con¬ 
versely,  a  good  fit  will  yield  a  precision  variance  not  significantly  larger 
than  the  dependent  variable  variance.  The  F-ratios  in  Figures  4  through  34 
(Lewis,  1960)  compare  these  variances;  none  is  significant  at  the  a  =  .05  level. 
But  this  is  somewhat  to  be  expected  because  the  experimental  design  could  eco¬ 
nomically  allow  sampling  at  only  four  values  of  the  independent  value,  and  the 
model  is  left  to  fit  the  four  resulting  mean  dependent  variable  values  with 
three  free  parameters.  A  "good"  fit  is  not  necessarily  "the"  fit;  there  are 
other  models  and  theoretical  functions  that  would  fit  the  data  just  as  well  or 
even  better.  For  example,  Cronholm  (1980)  has  pointed  out  that  if  both  simu¬ 
lator  and  aircraft  learning  curves  are  assumed  exponential  with  rate  parameters 
£  and  h,  respectively,  then  a  good  case  can  be  made  for  a  function  of  the  form 
j l  =  (h~^-)  ln(ae"2*L  +  c) . 

Thus  it  may  only  be  concluded  that  there  is  no  cogent  reason  for  reject¬ 
ing  as  a  viable  heuristic  the  model  under  consideration. 
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Selection  of  Independent  Variable  Levels.  As  mentioned  previously,  exper¬ 
imental  values  of  the  independent  variable  ideally  should  be  chosen  so  that 
not  all  three  yield  dependent  variable  values  falling  in  the  asymptotic  portion 
of  the  curve.  Despite  the  attempts  made  to  avoid  them,  such  choices  were  ap¬ 
parently  made  in  the  cases  of  several  maneuvers. 

For  example,  consider  "takeoff  to  a  hover”  shown  in  Figure  5.  Based  on 
various  considerations,  it  was  decided  to  sample  the  independent  variable  at 
levels  of  zero,  13,  19,  and  24  repetitions.  Inspection  of  Figure  5's  best-fit 
curve  indicates  that  13  or  more  AH1FS  training  repetitions  yield  results  in  the 
asymptotic  area  of  the  function.  The  reiterative  curve-fitting  routine  used, 
in  effect,  fit  these  asymptotic  data  with  a  line  parallel  to  the  abscissa. 1 
Although  it  may  be  that  one  training  repetition  in  the  AH1FS  is  effective  to 
the  extent  indicated  by  the  curve,  it  is  much  more  likely  that  if  an  independent 
variable  value  in  the  range  of  three  to  seven  repetitions  had  been  chosen,  a 
much  less  acute  function  would  have  been  obtained. 

A  somewhat  different  situation  seems  to  have  arisen  in  Figures  25  and  30 
through  34.  Figure  25  indicates  one  repetition  in  the  AH1FS  to  be  effective  in 
training  "hover  out  of  ground  effect,"  a  fairly  simple  maneuver,  but  that  almost 
no  additional  effectiveness  accrues  from  additional  repetitions.  Similarly,  it 
appears  that  the  gunnery  maneuvers  in  Figures  30  through  34  transfer  almost  im¬ 
mediately  and  completely  from  the  AH1FS  to  the  AH-1  aircraft. 


Integration  of  Cost  with  Training  Effectiveness 

Since  costing  procedures  for  both  the  simulator  and  the  aircraft  use  hours 
of  operation  rather  than  numbers  of  maneuver  repetitions,  the  training  analyst 
should  determine  the  average  time  required  per  maneuver  in  each  training  device 
prior  to  integrating  cost  and  training  effectiveness.  Then  the  appropriate 
transformations  of  axes  of  curves  such  as  those  in  Figures  4  through  34  can  be 
made  so  that  the  abscissae's  unit  of  measure  is  units  of  simulator  time  and  the 
ordinates'  unit  of  measure  is  units  of  aircraft  time. 


Device  Operation  Costs.  To  determine  economically  optimal  mixes  of  simu¬ 
lator  and  aircraft  time,  the  training  analyst  must  be  provided  the  cost  per  unit 
of  operating  time  for  both  devices.  If  this  figure  for  the  simulator  is  desig¬ 
nated  C  ,  then  the  function  describing  the  total  cost  of  x  units  of  simulator 


training  time  will  be  the  product  C  x  as  shown  in  Figure  35a.  Likewise,  if 

— s~ 

after  jc  units  of  simulator  training,  £  units  of  aircraft  training  are  required, 

the  total  cost  of  this  training  will  be  the  product  C  y,  where  C  is  the  cost 

—A  —A 

per  unit  of  aircraft  training  time.  Since  it  has  been  shown  that  the  units 
of  required  aircraft  training  time  can  be  expressed  as  a  function  of  x  as 
_bx 

ae  —  +  £,  then  the  cost  of  required  aircraft  training  can  be  more  explicitly 
expressed  as  C  (ae  —  +  £)  as  in  Figure  35b.  Then,  for  any  one  maneuver,  the 
total  cost  can  be  expressed  as 


^Note  that  for  moderately  large  values  of  b,  the  value  of  ae  —  quickly  ap¬ 
proaches  zero. 


f 
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a.  Cumulative  FS  training  cost  as  a  function  of  FS  training  time. 


b.  Cumulative  aircraft  training  cost  as  a  function  of  FS  training  time. 


c.  Cumulative  total  cost  as  a  function  of  FS  training  time. 


Figure  35.  Integration  of  simulator  and  aircraft  training  costs. 
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(6) 


C  =  C  X  +  c  (ae  —  +  c)  , 

—  — S—  —A  —  — 

which  is  shown  in  Figure  35c. 

Inspection  of  Figure  35c  indicates  a  point  at  which  total  cost  is  mini¬ 
mized,  and  it  can  be  shown  mathematically2  that  equation  6  is  at  a  minimum  when 

x  =  (InC  +  In  a  +  In  B  -  In  C  )  (b_1)  .  (7) 

A  b 


If  for  any  maneuver  m  this  optimal  value  of  x  is  denoted  as  x',  then  total  op- 
—  —  — m 

timized  training  cost  for  all  M  maneuvers  can  be  expressed  as 


M 


Si 


-E 

m=l 


-b  x" 


Cx 
— S-m 


(a_e 


c  ) 

— m 


(8) 


and  the  raw  savings  realized  will  be,  of  course,  the  difference  between  C 
evaluated  at  x  =  0  and  of  equation  8.  Thus  the  model  and  methodology 

presented  here  are  both  viable  and  of  great  utility  to  the  training  analyst. 


Further  Considerations 


Although  the  methodology  presented  here  is  fairly  straightforward,  there 
are  some  additional  factors  to  be  kept  in  mind  about  applying  its  results  in 
developing  a  simulator-based  training  system. 

Effects  of  Curriculum.  It  is  an  inescapable  fact  that  regardless  of  the 
level  of  technology  and  the  sophistication  of  a  simulator,  its  effectiveness  is 
a  function  of  how  it  is  used — of  how  the  trainer  incorporates  its  features  into 
a  training  program.  The  quantitative  measures  of  effectiveness  determined  by 
this  study  are  very  much  a  function  of  how  the  IPs  used  the  simulator  as  a 
training  device.  Also,  even  though  each  maneuver  is  treated  as  an  independent 
entity  by  the  methodology,  there  are  effects  of  training  sequences.  For  exam¬ 
ple,  antecedent  simulator  training  on  "normal  approach"  presumably  has  some  pos¬ 
itive  transfer  to  subsequent  simulator  training  on  "terrain  flight  approach." 
Thus,  as  the  simulator  instructional  tactics  are  refined,  the  AHIFS's  effective¬ 
ness  should  improve.  Consider  in  this  light,  the  trade-off  curves  determined  by 
the  study  represent  not  the  optimum  effectiveness  of  the  device,  but  the  base¬ 
line  effectiveness. 


=  Cg  -  C^abe  — ,  which,  when  set  at  zero  and  solved  for  x,  yields  equation  7. 

d2c 

— —  >  0  (given  a  >  0  and  b  >  0)  implies  that  x  in  equation  7  represents  a 

dx 

minimum. 
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Restricted  Device  Availability.  Most  modern  simulators  are  expensive  and 
must  be  distributed  among  a  large  number  of  trainees.  In  all  cases,  the  train¬ 
ing  analyst  will  have  the  device  available  for  a  certain  period  each  day.  In 
many  cases  the  analyst  is  also  faced  with  cycling  through  the  curriculum  a  large 
number  of  students  within  a  fixed  number  of  training  days.  These  restrictions 
determine  the  amount  of  simulator  time  available  to  each  student.  Ideally,  the 
amount  of  time  per  student  would  be  at  least  equal  to  the  total  optimal  maneu¬ 
ver  training  times.  In  many  instances,  this  is  not  the  case,  and  less  than  op¬ 
timal  training  curricula  must  be  set  up  according  to  some  trade-off  scheme. 

In  his  implementation  of  the  integration  procedures  outlined  here,  Hopkins 
(1980)  ordered  the  simulator-trainable  maneuvers  in  terms  of  each  maneuver's 
savings  per  hour  of  simulator  operation.  (In  general,  more  savings  per  unit  of 
simulator  operating  time  accrue  to  maneuvers  for  which  the  difference  a  -  £  is 
great  and  the  rate  parameter  b  is  large.)  Choosing  a  hypothetical  hour 
availability  per  student,  he  simply  cumulated  the  x'  values  (in  terms  of  time) 
down  the  rank-ordered  list  of  maneuvers  until  they  totaled  3*5  hours.  Other 
trade-off  schemes  might  involve  such  considerations  as  weighting  each  maneuver 
according  to  the  danger  associated  with  performing  it  in  the  aircraft. 


Conclusions 


At  the  practical  level,  the  model  and  methodology  have  been  demonstrated 
as  both  viable  and  of  utility.  The  model  does  not  concern  itself  directly  with 
such  issues  as  fidelity  and  realism,  but  addresses  directly  the  effectiveness 
of  the  simulator  in  decreasing  required  aircraft  training  time.  As  expressed 
in  equation  5,  the  model  considers  only  antecedent  simulator  training  as  a  pre¬ 
dictor  variable.  Other  variables,  such  as  student  experience  level,  student 
aptitude,  or  cumulative  negative  effects  of  simulator  training  can  be  incorpo¬ 
rated  into  the  model.  However,  the  cost  of  empirically  evaluating  such  an  ex¬ 
panded  model  will  increase  in  terms  of  levels  of  independent  variables  sampled 
and  number  of  experimental  subjects  required. 
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